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ON  POSITIVE  PRINCIPAL  MINORS 


N 


by 


George  B.  Dantzig 


1) 


When  a  matrix  is  symmetric,  the  property  of  having  all  its 
principal  minors  positive,  is  equivalent  to  being  positive  definite. 
When  a  matrix  is  non-symmetric  this  is  no  longer  true.  For  example 


(1) 


7 

1 


has  all  positive  principal  minors,  but 

2  2 

xMx  -  x1  -  7xix2  +  *2  <  0  for  x  “  (xi»x2^  "  (1»1) 

The  converse,  however,  as  shown  in  Gale-Nikaido  [  i  ] ,  Cottle  [2  ] 
is  true: 

Theorem  1:  The  class  with  positive  principal  minors  properly  includes 
those  which  are  positive  definite. 

Proof :  Assume  M  is  positive  definite,  M  is  non  singular  for  if  not, 
then  there  would  exist  x  ■  x°  j*  0  such  that  Mx°  ■  0;  yielding 
x°ttx°  -  0,  a  contradiction.  It  follows  that  every  principal  submatrix 
of  M  is  also  nonsingular. 

^The  author  acknowledges  leads  suggested  by  David  Gale. 


1 


Partition  M  so  that 
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x*  -  [Y*,-l]  where  Y*M,  -  r.  Then 


But 


*—  *  * 
x  Mx  -  [Y  ,-l] 


det 


Mic 


r  a 


mmJ 


r  det 


r 

_ 

r 

H1 

c 

Y 

r 

a 

-1 

- 

mm  J 

- 

c 

* 

- 

a 

-  Y  c 

mm 

-  (a  -  Y  c)>  0 
nun 


V  vmm 


Thus  det  M  and  its  largest  order  principal  minor  have  the  same  sign. 
Inductively,  since  first-order  principal  minors  are  positive,  so  must 
the  second  order  ones,  etc.,  up  to  the  highest  order.  Finally, 
example  (1)  shows  that  the  Inclusion  is  proper. 

Although-  positive  definite  matrices  M  do  not  comprise  the  entire 
class  of  positive  principal  minors,  they  can  be  used  to  generate  a 
larger  class  by  multiplying  M  by  diagonal  matrices  on  the  right 
and  left-  to  form  DME.  For  example, 


positive  positive  principal  minors  but 

definite  not  positive  definite 


It  is  not  difficult  to  show  that  for  2x2  matrices  the  entire 


\ 


positive  principle  minor  class  can  be  so  obtained  from  the  positive 
definite  class.-  The  following  is  easily  seen. 


Lemma:  Let  D  ■  [d^J,  E  -  [e^J  be  diagonal  matrices  with  the 
property  that  d^e  >  0,  then  for  any  M  the  sign  (+,  -,  or  0) 
of  any  principal  minor  of  DME  is  the  same  as  that  of  m.  If  M 
is  positive  definite,  then  DME  has  positive  principal  minors. 


Theorem  2:  If  M  has  positive  principal  minors  and  there  exist 
diagonal  D  and  E  such  that  M  ■  D  ^ME  ^  is  positive  definite, 
then  there  exists  a  diagonal  matrix  F  such  that  F  "SiF  is  positive 
definite. 


Proof  i  If  M  is  positive  definite  so  is  AMAT  for  any  nonsingular 
A  (since  x(AMAT)xT  -  yMyT  >  0  where  x  )•  0  and  y  -  xA  j*  0).  We 
consider  AMAT  -  AD  HlE  *AT  and  choose  A  bo  that  AD  1  ■  (E  *AT)  * 


or  A  A  ■  ED.  Thus  A  *  [a^]  could  be  chosen  as  a  diagonal 
matrix  such  that  a^  Then  F  -  [f^]  *s  t^e 


-1  T  - - 

diagonal  matrix  F  ■  E  A  where  f^  -  +  /d^/e^  . 


Theorem  3:  The  characteristic  roots  of  (any)  M  are  the  same  as 
F  *MF  for  (any)  nonsingular  F 


2) 


A  veil  known  result  of  matrix  theory. 
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Proof:  By  definition,  X  is  a  characteristic  root  of  M  if  there 
exists  an  x  0  such  that  Mx  *  Xx.  Setting  Fy  ■  x  then  y  ^  0 
if  x  j4  0  and  we  have  MFy  ■  XFy  or  (F  ^MF)  y  ■  Xy  so  that  X 
is  a  characteristic  root  of  (F  ^1F)  also. 


Theorem  4:  If  M  is  positive  definite,  the  real  part  of  every 

3) 

characteristic  root  is  positive. 

Proof :  Let  Mx  ■  Xx,  x  +  0  and  let  x  -  u  +  iv,  X  ■  R  +  IS,  then 
by  substitution  and  equating  the  real  and  Imaginary  parts 


Mu  ■  Ru  -  Sv 


(u,v)  +  0 


Mv  ■  Rv  +  Su 


Now  R  >  0  follows  from 


T—  t—  2  2 

0  <  u  Mu  +  v  Mv  ■  R  (u  +  v  ) 


The  following  is  known,  see  Gale  -  Nikaido  [  l  ] . 


Theorem  5:  If  M  has  positive  principal  minors,  then  every  real 
characteristic  root  is  positive. 


' A  well  known  result  in  matrix  theory  that  is  reviewed  here  for 
non-symmetric  M. 


i  . 
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Proof :  The  characteristic  equation  is  obtained  by  setting 


det  [M  -  XI]  -  0 


this  yields 


<-X)n  +  C.C-X)®"1  +  c.  (-X)®"2  +  ...  +  C  -  0 

Li  m 


where  is  the  sum  of  the  j-th  order  principal  minors.  For 

matrices  with  positive  principal  minora,  C^>  0.  It  is  not  possible 
that  X  <.  0  because  then  all  terms  above  would  be  non-negative 
and  the  last  term  positive  so  that  the  left  hand  side  would  be 
strictly  positive,  a  contradiction. 


Theorem  6  (Kalman*) :  There  exist  matrices  M  with  positive  principal 
minors  that  have  characteristic  roots  not  all  of  which  have 
positive  real  parts;  for  such  matrices  no  transformation  M  -  DME 
exists  with  diagonal  matrices  D  and  E  such  that  M  is  positive 
definite. 


In  a  letter  to  D.  Gale  dated  9  July  1962,  Rudolf  E.  Kalman  showed  that 


10/3  -  4  -  /ll.l 

8/3  1/3  -  /  1.1 

L-/899. 1-^89. 1  30  J 


had  positive  minors  but  had  complex  characteristic  roots  with 
negative  real  parts. 
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Proof;  If  such  D  and  E  did  exist,  then  by  Theorem  2,  an  F  would 
exist  such  that  FMF  ^  is  positive  definite.  By  Theorem  4  FMF”^ 
would  have  to  have  characteristic  roots  with  positive  real  parts. 

By  Theorem  3  the  same  would  be  true  for  M.  However  M  in  the 
example  below  does  not  have  this  property. 


M  - 


1 

1 

4 


-1  0 
1  17 
0  1. 


The  first  order  principal  minors  are  1,  1,  1  whose  sum  ■  3, 
its  second  order  ones  are  2,  1,  1  whose  sum  is  C2  ■  4.  Its  third 
order  one  is  ■  70.  Thus  M  has  positive  principal  minors.  Its 
characteristic  equation  is 

X3  -  c^x2  +  c2x  -  c3  -  0 

or  X3  -  3X2  +  4X  -  70  -  0 


which  factors  into 

(X  -  5) (X2  +  2X  +  14)  -  0 
The  characteristic  roots  are 


X1  "  +5*  x2  "  _1  +  x3  “  "1_  i»^3 

Since  the  real  parts  of  X2  and  X^  are  negative,  this  establishes  that 
the  class  of  positive  principal  minor  matrices  form  a  larger  class 


6 


> 


than  those  generated  from  the  positive  definite  ones  by  simple 
rescaling  of  the  rows  and  columns. 

In  mathematical  programming  one  seeks  p-vectors  x,y  ^  0 
that  satisfy  y  ■  Mx  +  q  such  that  the  products  x^y^  "  0  for 
i  ■  l,2,..,p.  The  latter  conditions  may  be  replaced  by  the 

IT  j 

minimum  value  of  xy-xMx+xq,  a  quadratic  function  which  is 

convex  if  and  only  if  M  is  positive  definite.  Certain  solution 

procedures  based  on  convexity  [  2  ] ,  [  3  ] »  [  4  ]  turn  out  to  be  also 

valid  even  when  M  has  positive  principal  minors.  This  leads  to 

the  speculation  that  by  a  simple  change  of  units  of  x,y  one  could 

obtain  a  new  system  y  -  Mx  +  q,  (y,x>2.0,  y^Xj-  0  for  i  -  l,..,p 

-T--  -T 

in  which  the  quadratic  function  x  Mx  +  x  q  is  convex.  However 
we  have  shown  that  this  is  not  always  possible  to  do.  The  class 
of  positive  principal  minor  matrices  does  not  appear  to  be  a 
trivial  extension  of  positive  definite  matrices.  Solution 
techniques  also  valid  for  the  latter  have  somehow  gotten  around 
the  difficulties  of  local  optimality  usually  associated  with 
nonconvex  programming  problems. 

An  open  question  posed  by  Gale  and  Kalman  and  closely  related 
to  considerations  found  in  a  paper  by  Arrow  and  McManus  [5]  is  the 
following : 

Suppose  for  all  diagonal  matrices  D  such  that  d^  >0,  that 
M  has  the  property  that  the  real  part  of  every  characteristic 
root  of  MD  is  positive,  does  this  imply  there  exists  a  D  ■  D" 
such  that  D°M  is  positive  definite? 
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